feat: deploy vllm-render as standalone service; use simulated render in e2e#1601
Merged
Conversation
mayabar
marked this pull request as draft
June 11, 2026 11:28
mayabar
force-pushed
the
e2e-test-single-render
branch
from
June 17, 2026 11:10
cb95763 to
e8049e7
Compare
mayabar
marked this pull request as ready for review
June 17, 2026 13:05
mayabar
force-pushed
the
e2e-test-single-render
branch
from
June 21, 2026 10:44
d499a34 to
bbb0e0b
Compare
elevran
reviewed
Jun 21, 2026
elevran
left a comment
Collaborator
There was a problem hiding this comment.
Good PR - thanks!
It clean removal of external test dependencies and YAML mutation machinery. A few suggestions/nits before merging are noted inlnie.
Also - please resolve conflicts,
mayabar
force-pushed
the
e2e-test-single-render
branch
from
June 22, 2026 12:37
bbb0e0b to
7d90a62
Compare
elevran
reviewed
Jun 22, 2026
Collaborator
|
Not that users use the helm charts for deployment, so this PR doesn't practically enable vllm-render as a standalone for end users. |
mayabar
force-pushed
the
e2e-test-single-render
branch
from
June 24, 2026 12:19
7d90a62 to
abba7a5
Compare
mayabar
force-pushed
the
e2e-test-single-render
branch
from
July 6, 2026 10:39
abba7a5 to
200efe7
Compare
Contributor
Author
@ahg-g That's correct. The scope of this specific PR is strictly limited to updating the e2e tests and the kind deployment. Is this scope ok from your point of view? |
mayabar
force-pushed
the
e2e-test-single-render
branch
from
July 7, 2026 11:55
9fe0355 to
b50eb64
Compare
mayabar
force-pushed
the
e2e-test-single-render
branch
from
July 12, 2026 12:54
b50eb64 to
c986495
Compare
mayabar
force-pushed
the
e2e-test-single-render
branch
from
July 15, 2026 11:22
c986495 to
407c6fd
Compare
mayabar
force-pushed
the
e2e-test-single-render
branch
2 times, most recently
from
July 15, 2026 18:11
1f48d63 to
ca097d6
Compare
…ulator pods Signed-off-by: Maya Barnea <mayab@il.ibm.com>
Signed-off-by: Maya Barnea <mayab@il.ibm.com>
Signed-off-by: Maya Barnea <mayab@il.ibm.com>
Signed-off-by: Maya Barnea <mayab@il.ibm.com>
Signed-off-by: Maya Barnea <mayab@il.ibm.com>
Signed-off-by: Maya Barnea <mayab@il.ibm.com>
mayabar
force-pushed
the
e2e-test-single-render
branch
from
July 15, 2026 19:01
6ffbe6b to
f74e466
Compare
elevran
approved these changes
Jul 16, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What type of PR is this?
/kind feature
/kind test
What this PR does / why we need it:
Extracts the vllm-render container from the EPP Deployment sidecar into its own standalone Deployment + Service. This makes the render service independently scalable — operators can tune replica count without touching the EPP deployment. It also removes the tight coupling between EPP and render lifecycle.
For e2e tests, replaces the real vllm-render instance with the inference simulator image running with --force-dummy-tokenizer.
This eliminates:
The EPP config is updated to point at
http://vllm-render:8082(the new Service) instead ofhttp://localhost:8000, and simulators receive --force-dummy-tokenizerto match.Which issue(s) this PR fixes:
Ref #1595
Release note (write NONE if no user-facing change):
vllm-renderis now deployed as an independent Deployment and Service rather than a sidecar in the EPP pod, allowing it to be scaled independently.